The widespread adoption of large language models (LLMs) has created a pressing need for an efficient, secure and private serving infrastructure, which allows researchers to run open source or custom fine-tuned LLMs and ensures users that their data remains private and is not stored without their consent. While high-performance computing (HPC) systems equipped with state-of-the-art GPUs are well-suited for training LLMs, their batch scheduling paradigm is not designed to support real-time serving of AI applications. Cloud systems, on the other hand, are well suited for web services but commonly lack access to the computational power of HPC clusters, especially expensive and scarce high-end GPUs, which are required for optimal inference speed. We propose an architecture with an implementation consisting of a web service that runs on a cloud VM with secure access to a scalable backend running a multitude of LLM models on HPC systems. By offering a web service using our HPC infrastructure to host LLMs, we leverage the trusted environment of local universities and research centers to offer a private and secure alternative to commercial LLM services. Our solution natively integrates with the HPC batch scheduler Slurm, enabling seamless deployment on HPC clusters, and is able to run side by side with regular Slurm workloads, while utilizing gaps in the schedule created by Slurm. In order to ensure the security of the HPC system, we use the SSH ForceCommand directive to construct a robust circuit breaker, which prevents successful attacks on the web-facing server from affecting the cluster. We have successfully deployed our system as a production service, and made the source code available at https://github.com/gwdg/chat-ai

Chai empowers users to create and interact with customized chatbots, offering unique and engaging experiences. Despite the exciting prospects, the work recognizes the inherent challenges of a commitment to modern safety standards. Therefore, this paper presents the integrated AI safety principles into Chai to prioritize user safety, data protection, and ethical technology use. The paper specifically explores the multidimensional domain of AI safety research, demonstrating its application in Chai's conversational chatbot platform. It presents Chai's AI safety principles, informed by well-established AI research centres and adapted for chat AI. This work proposes the following safety framework: Content Safeguarding; Stability and Robustness; and Operational Transparency and Traceability. The subsequent implementation of these principles is outlined, followed by an experimental analysis of Chai's AI safety framework's real-world impact. We emphasise the significance of conscientious application of AI safety principles and robust safety measures. The successful implementation of the safe AI framework in Chai indicates the practicality of mitigating potential risks for responsible and ethical use of AI technologies. The ultimate vision is a transformative AI tool fostering progress and innovation while prioritizing user safety and ethical standards.

Fox News correspondent Grady Trimble has the latest on fears the technology will spiral out of control on'Special Report.' It's not uncommon to catch drivers singing by themselves in their cars, but soon you may see more of them having conversations instead. Automakers around the world are jumping on the artificial intelligence bandwagon and aiming to offer ChatGPT and similar generative AI features in their vehicles soon. "Having an assistant and really being able to use voice that is clear enough that you can ask questions and get answers, I think that's what the artificial intelligence will enable us to do," GM CEO Mary Barra recently told FOX Business. One company that knows a lot about chit-chat on the move is SoundHound, a major supplier of voice recognition systems used by several automakers, including Hyundai and Mercedes-Benz.

You've seen it on TV, you've read about it on news websites. Artificial Intelligence, commonly referred to as AI, is now the hottest industry. Stocks that are involved in this industry are taking off. I originally wrote about a form of artificial intelligence back in October of 2021 in an article called The Future of Artificial Intelligence: Can You Invest In It Now? So you may be wondering what companies are the purest plays.

Who'd have thought anyone would use Bing in 2023? Bing has crossed 100 million daily active users a month after the launch of its chatbot AI, according to Yusuf Mehdi, Microsoft's VP for Modern Life, Search and Devices. He said the company is fully aware it's still just "a small, low, single-digit share player," but hey, there was a time when Bing wasn't even a part of the conversation. Around a third of Bing's daily preview users have been using its chat AI for their queries. On average, Microsoft is seeing three chats per session, with over 45 million chats since it introduced the new Bing.

Bing has crossed 100 million daily active users a month after the launch of its chatbot AI, according to Yusuf Mehdi, Microsoft's VP for Modern Life, Search and Devices. He said the company is fully aware that it's still just "a small, low, single digit share player," but hey, there was a time when Bing wasn't even a part of the conversation. Now, after the tech giant released its next-gen version, even those who haven't used it in the past are relying on it for their searches: Mehdi noted that one-third of Bing's daily active users are new to the search engine. "We see this appeal of the new Bing as a validation of our view that search is due for a reinvention and of the unique value proposition of combining Search Answers Chat Creation in one experience," the VP said. In addition to seeing a boost in numbers, Microsoft is also apparently enjoying a growth in engagement, with more people conducting more searches. The company credits two factors for that particular victory, the first being Edge's growth in usage, most likely aided by the addition of Bing's chat AI as a new feature.

Senior Researcher Chris Dede isn't overly worried about growing concerns over generative artificial intelligence, like ChatGPT, in education. As a longtime researcher on emerging technologies, he's seen many decades where new technologies promised to upend the field. Instead, Dede says artificial intelligence requires educators to get smarter about how they teach in order to truly take advantage of what AI has to offer."The But if you educate them for what AI can't do, then you've got IA [Intelligence Augmentation]," he says. Dede, the associate director of research for the National AI Institute for Adult Learning and Online Education, says AI raises the bar and it has the power to significantly impact learning in powerful ways. In this episode of the Harvard EdCast, Dede talks about how the field of education needs to evolve and get smarter, in order to work with -- not against -- artificial intelligence. This is the Harvard EdCast. Chris Dede thinks we need to get smarter about using artificial intelligence and education. He has spent decades exploring emerging learning technologies as a Harvard researcher.